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BACKGROUND 


RADC  has  supported  DMA  for  a  number  of  years  In  developing  and  configuring 
software  and  hardware  Into  a  test  bed  Imagery  Processing  system  which  has  since 
been  Installed  at  DMA  Hydrographic  &  Topographic  Center  (DMAHTC)  and  Aero  Space 
Center  (DMAAC)  and  at  RADC/IRRE.  The  system  was  designed  as  a  user  friendly 
test  bed  for  continued  development  and  evaluation  of  semi-automatic  computer 
assisted  techniques  to  perform  various  feature  extraction  functions.  The  test 
bed  includes  a  collection  of  system  and  application  software  modules  which 
support  a  variety  of  functions  required  In  the  image  exploitation  process. 
Application  software  Includes  pixel  measurement  extraction,  pixel  classification 
pattern  recognition,  image  enhancements  and  manipulations,  etc.  More  recently  a 
software  subsystem  package  was  developed  and  Installed  at  each  facility 
providing  a  capability  to  perform  Image  restoration  operations  on  digital 
Imagery.  This  subsystem  termed  Image  Restoration  and  Manipulation  Software 
(IRAMS)  was  designed  to  provide  a  highly  Interactive  semi-automatic  degradation 
assessment  capability  and  a  collection  of  Image  restoration  filters  housed  on 
one  computing  facility.  The  IRAMS  package  represents  the  most  comprehensive 
single  Installation  of  Image  restoration  filters  available  to  date.  This 
software  combined  with  existing  and  In  development  Image  processing  and 
artificial  Intelligence  software  offers  a  unique  experimental  tool  for  further 
research  addressing  critical  Image  processing  Issues,  algorithm  development  and 
digital  technology  Impacting  DMA  and  Air  Force  evolution  to  softcopy  automatic 
Image  exploitation  applications. 
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The  purpose  of  this  report  Is  to  document  results  of  an  effort  whereby  a 
number  of  Image  restoration  filters  were  experimentally  evaluated  on  the 
RADC/IPS.  The  evaluation  performed  Is  unique  In  that  restoration  performance  Is 
evaluated  for  facilitating  machine  classification  rather  than  for  human 
Interpretation  as  was  the  case  In  known  past  reported  work  (10,  11).  This 
route  was  taken  since  the  Image  exploitation  function  is  evolving  Into  an 
automatic  operation  and  required  preprocessing  functions  (l.e.  restoration 
enhancements,  etc)  should  be  compatible  with  and  facilitate  machine 
classification  and  recognition  In  the  long  term. 


vlll 


SECTION  I 


OBJECTIVE 


1.0  The  main  objective  of  this  experimentation  Is  to  systematically  evaluate  and 
compare  the  performances  of  different  image  restoration  filters  in  machine 
classification  so  as  to  ascertain  their  usefulness  in  facilitating  machine 
recognition.  More  spec  leal 1y,  the  following  items  were  performed: 

(1)  Analyze  image  ^storation  filters  to  gain  insights  that  may  lead  to  the 
development  of  guideline  for  practical  applications  and  ideas  for  designing  new 
filters. 

(2)  Test  and  evaluate  six  restoration  filters:  Inverse,  Wiener,  Parametric 
Wiener,  Geometrical  Mean,  PSE,  and  Median  filter  on  images  of  various  degrees  of 
degradation  based  on  their  performances  in  machine  classification  of  the  scene 
in  the  Image. 

(3)  Derive  an  appropriate  performance  measure  in  order  to  quantify 
performances  of  the  filters. 

(4)  Compare  these  filters  under  different  distortion  conditions. 

This  investigation  was  not  concerned  with  the  interrelationship  between 
restoration  filtering,  feature  extraction  and  classifying.  In  other  words,  the 
mutual  effects  between  filters,  feature  extractors,  and  classifiers  were  not 
considered.  Moreover,  the  many  image  enhancement  techniques  which  undoubtedly, 
facilitate  machine  recognition  were  also  not  considered. 


SECTION  II 


» 


DISCUSSION  OF  THE  RESTORATION  PROBLEM 

2.0  The  image  restoration  problem  is  mathematically  ill  conditioned,  hence  there 
is  no  unique  solution.  A  variety  of  restoration  filters  have  been  proposed  1. 
2,  3,  4,  5,  6,  7,  notably  the  Inverse,  Weiner,  Parametric  Wiener,  Geometrical 
Mean,  Power  Spectrum  Equalization  (PSE),  Pseudo-Inverse,  Homomorphic,  Kalman, 
MAP,  ML,  MEM,  Median  etc  filters.  These  filters  were  designed  according  to 
different  sets  of  specific  mathematical  criteria  based  on  various  assumptions  of 
the  image  models.  In  practice  filter  performance  varies  with  the  type  of  image, 
the  blur  and  the  noise  conditions.  It  is  natural  to  ask  the  following  question: 
How  well  do  the  various  filters  enhance  human  interpretation  of  the  image  or 
facilitate  machine  recognition?  Or  which  filter  is  better  than  the  other  and 
under  what  conditions?  Systematic  evaluation  and  assessment  of  relative 
performance  between  filters  is  badly  needed,  since  it  will  facilitate  judicious 
selection  of  filters  for  use  in  Air  Force  automatic  target  classification  and 
identification  systems  using  high  resolution  reconaissance  imagery.  Furthermore 
the  resultant  information  will  provide  insight  and  a  sound  basis  in  designing 
new  filters  for  similar  Air  Force  image  exploitation  missions. 

This  report  concentrates  on  the  investigation  and  evaluation  of  performance 
of  six  image  restoration  filters;  viz.  Inverse,  Wiener,  Parametric  Wiener  (<*=?*), 
Geometrical  Mean  (  %  =  =  k)t  PSE,  and  Median  filters.  The  basic  model  for  a 
permanently  recorded  or  observed  image  g  (x,  y)  is  usually  given  as: 

9  (x,y)  =  $  H  [f(x,y)]|  +  or  x  n  (x,y)  (1) 
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where  s  Is  a  function  representing  the  Image  sensor  response;  H,  an  operator 
representing  the  Image  formation  process;  f(x,y),  the  original  undistorted  Image 
or  original  object  Images;  n(x,y)  a  random  noise  (formulated  as  either  an 
additive  or  multiplicative)  process  due  to  the  record  medium  and/or  electronic 
circuit  used  In  Image  recording.  The  goal  of  Image  restoration  Is  to  retrieve 
f(x,y)  from  g(x,y).  To  be  more  precise,  the  restoration  problem  may  be  stated 
as:  given  the  recorded  and  distorted  image  g  (x,y),  knowledge  about  the  type  of 
the  noise  n(x,y),  possibly  some  knowledge  of  the  original  image  f(x,y),  and  some 
knowledge  about  the  image  formation  in  terms  of  the  point-spread-function  (PSF), 
estimate  the  original  undistorted  image  or  original  object  intensity 
distribution  f(x,y).  The  model  given  in  Eq.  (1)  is  too  general  to  be  useful  in 
designing  restoration  filters.  In  practice,  assumptions  and  approximations  are 
made  to  render  the  design  and  implementation  of  restoration  filters  to  be 
reasonably  manageable.  In  many  instances,  the  non-linear  function  or  operator 
is  approximated  by  a  linear  one;  the  image  formation  is  approximated  by 
convolution  with  a  space- invariant  point-spread  function  (SIPSF);  and  the  noise 
is  assumed  to  be  additive  white  Gaussian.  It  is  apparent  that  the  ill 

conditioned  nature  of  the  restoration  problem  together  with  the  variety  of  image 
model,  assumptions  and  approximations,  and  mathematical  criteria  for 
optimization  results  in  the  many  different  restoration  filters  available. 
Moreover,  it  would  be  impossible  to  test  and  evaluate  all  of  the  filters.  With 
the  desire  to  encompass  a  wide  range  of  restoration  filters  and  to  keep 
computation  within  the  support  of  "IRAMS"  (Image  Restoration  and  Manipulation 
Software)  implemented  by  PAR  Corp  for  RAOC,  the  above  cix  filters  were  selected 
for  evaluation. 
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Since  the  Air  Force  and  Defense  Mapping  Agency  are  emphasizing  machine 
classification  and  identification  and  the  restoration  filters  are  intended  to  be 
used  as  preprocessor  for  a  pattern  recognition  system,  it  seemed  more 
appropriate  to  evaluate  the  restoration  filters  based  on  how  well  they  perform 
for  machine  classifiers  rather  than  for  photointerpreters.  Previous  image 
restoration  work  was  aimed  at  producing  "nice  looking"  pictures  to  please  human 
observers.9  However,  a  lack  of  knowledge  about  the  psychophysical  processes  of 
human  vision  and  a  universal  criterion  for  "beauty"  hindered  efforts  in  a 
systematic  evaluation  and  comparison  of  restoration  filters.  Cannon,  et  allO 
did  work  on  the  evaluation  and  comparison  of  restoration  filters  based  on  a 
mathematical  criterion  and  the  judgment  of  a  panel  of  photointerpreters.  They 
compared  three  filters,  viz,  Wiener,  PSE,  and  MAP.  They  concluded  that  based  on 
the  subjective  quality  of  photointerpreters,  all  filters  perform  equally  well  on 
Gaussian  blurred  images  regardless  of  signal-to-noise  ration  (SNR)  level,  blur 
severity,  or  image  type;  however,  MAP  filter  seems  to  work  best  on  defocused 
image  in  high  signal-to-noise  environment.  Based  on  the  particular  mathematical 
criterion  (minimum  mean  square  error),  the  Wiener  filter,  as  expected  performed 
best.  Another  closely  related  workll  aimed  at  evaluating  the  effect  of 
degradation  of  images  on  photo  interpretabi lity  and  subjective  quality  without 
any  restoration  performed  on  the  images.  The  criteria  which  was  used  in 
measuring  the  degradation  effect  on  human  observers  are: 

(a)  Performance  by  trained  photo- interpreters  (Pi's)  in  the  extraction  of  a 
set  of  essential  elements  of  information  from  degraded  photos,  and 

(b)  Subjective  quality  as  scored  by  the  Pi's  based  on  the  10-point  NATO 
standardized  scale. 
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Their  conclusion  was.  Indeed,  that  the  Interpretablllty  has  been  re 
proportion  to  the  degree  of  degradation  by  both  blur  and  noise;  howe 
noise  had  less  effect  In  reducing  Interpret ability.  Somehow  the  Pi's 
through  noise  but  not  blur.  The  subjective  quality  as  measured  by 
Scale  was  worsened  in  either  case  when  noise  was  increased  but 
decreased  or  when  noise  was  decreased  but  blur  was  increased.  For  1 
Pi's,  the  correlation  between  subjective  quality  and  interpretablllty 
however,  for  Pi's  as  a  group,  the  mean  correlation  was  high.  To 

knowledge  of  the  authors,  there  has  been  no  work  reported  for  evaluat 
restoration  filters  for  machine  recognition.  However,  the  effects  < 
filtering  on  machine  analysis  of  images,  for  edge  detection,  shape  anal 
texture  analysis  were  reported. 12 
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SECTION  III 


MATHEMATICAL  FORMULATION  OF  RESTORATION 

3.0  The  image  model  given  in  Eq.  (1)  provides  an  accurate  characterization  of 
image  formation  but  it  is  too  general  to  be  useful  for  filter  design.  For  most 
linear  filters,  the  sensor  function  s  is  approximated  by  a  linear  function;  the 
image  or  blur  operator  H  is  assumed  to  be  linear  and  represented  by  spatial- 
invariant  point-spread  function;  and  the  noise  is  assumed  to  be  additive.  Based 
on  these  assumptions  the  observed  image  g(x,y)  becomes: 

g(x,y)  «  h  (x,y)  *f (x,y)  +  n  (x,y)  (2) 

where  *  signifies  two-dimensional  convolution  and  h(x,y),  the  PSF.  Six  filters 
were  chosen  for  testing  and  evaluation  as  mentioned  previously.  The  first  five, 
viz..  Inverse,  Wiener,  Parametric  Wiener,  Geometrical  Mean,  and  PSE  filters, 
represent  essentially  the  entire  range  of  linear  filters.  They  were  derived 
based  on  the  linear  model  given  in  Eq.  (2).  Wiener  filtering  is  perhaps  the 
most  common  restoration  method  used.  Parametric  Wiener  filtering  seems  to  give 
visibly  good  results. 13  Geometrical  mean  filtering  allows  the  inverse  filter  to 
boost  the  high-frequency  components  in  a  controlled  fashion. I4  PSE  filtering 
seems  to  give  a  pleasing  clear  picture. 15  The  sixth,  median  filter,  is  a 
nonlinear  filter  which  is  useful  for  noise  reduction  and  edge  preservation. 8 
Thus,  the  filters  chosen  for  evaluation  represent  a  wide  range  of  available 
filters.  Derivation  of  these  filters  can  be  found  in  References  (1)  and  (2)  and 
will  not  be  repeated  here.  A  brief  mathematical  analysis  of  these  filters  is 
given  below: 

3.1  Inverse  filter  -  Based  on  the  model  given  in  Eq.  (2)  and  the  criterion  of 
minimizing  the  norm  ( i . e. ,  power)  of  the  noise,  the  inverse  filter  expressed  as 
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transfer  function  Is  derived  as: 


h‘(^h)= 


(3) 


where  H  (wx,  wy)  Is  the  optical  transfer  function  (OTF);  l.e.  the  2-D  Fourier 

(4) 


transform  of  the  PSF  h(x,y)  In  Eq.  (2 

A  w  / 


The  restored  Image  Is  then 

[  G  C^xjCJt ) 

H  (VfjUtj)  . 

Using  the  operator  matrix  and  vector  notation,  and  including  additive  noise,  it 

Is  seen  that  -f  =  H  Hi f  +  H  ■>?  =  f  +  JtL  ^  (5) 

which  gives  the  original  image  f  plus  the  transformed  noise.  In  the  absence  of 
noise  and  singularities  of  the  filter,  one  could  restore  the  distorted  image  to 
the  original  form  perfectly.  It  is  seen  that  the  inverse  filter  concentrates  on 
regaining  the  original  image  but  disregards  (even  amplifies)  the  noise.  It  is 
reasonable  to  expect  that  the  inverse  filter  will  perform  well  if  the  noise 
level  is  low  and  there  are  no  singular  values  of  H  (wx,  wy)  for  any  wx  and  wy. 
In  general,  OTF's  exhibit  a  low  frequency  "hump"  and  thus  H-l  (wx,  wy)  tends  to 
boost  the  high-frequency  portion  of  an  image. 

3.2  Wiener  filter  -  Using  the  linear  model  in  Eq.  (2)  and  minimizing  the  mean 

squared  error  between  the  original  and  the  restored  image  one  obtains  the  Wiener 

filter.  II*,  . 

M*.  <^<i) _ 

(6) 


,  \  _  _ H  _ 


where  H  (wx,  wy)  is  again  the  OTF;  Sn  (wx,  wy),  the  noise  power  spectrum  density 
(PSD);  and  Sf  (wx,  wy),  the  PSD  of  original  (or  desired)  image.  In  practice, 
d.c.  components  (if  any)  in  Sn  and  Sf  are  subtracted.  It  is  obvious  that  Wiener 
filtering  reduces  to  inverse  filtering  In  the  absence  of  noise.  For  this 
reason,  the  noise-to-signal  ratio  term  [sn/Sfj  in  the  expression  of  Wiener 
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filter  may  be  viewed  as  a  modification  function  that  smoothes  the  Inverse  filter 
and  even  eases  the  problem  created  by  the  singularities  of  OTF  to  provide 
optimum  restoration  in  the  presence  of  noise.  The  restored  image  in  the 


frequency  domain  is: 


=|n<v>>^)|%r5±^i>]  |h t 

*  [£f  (7) 

where  F  (wx,  wy)  and  N  (Wx,  Wy)  are  the  Fourier  transforms  of  sample  functions 
of  the  original  image  process  and  the  noise  process,  respectively.  This  shows 
that  the  restored  image  consists  of  somewhat  distorted  original  and  reduced 
noise.  In  other  words,  Wiener  filter  does  not  concentrate  all  its  effort  in 
regaining  (deblurring)  the  original  image  but  also  operates  on  the  noise  ?s 
represented  by  the  ^Sn/Sf  term  in  the  denominator.  Since  j h| 2  and  £sn/Sfj  in 
the  denominator  are  equal  y  weighted,  the  effort  of  Wiener  filter  in  deblurring 
the  image  and  reducing  the  noise  is  equally  distributed.  If  it  is  desired  that 
more  emphasis  be  put  on  deblurring  and  less  emphasis  on  reducing  noise,  then  the 


influence  of  the 


Sn/Sf 
»  « 


term  in  Eq.  (7)  should  be  reduced  so  that  the  Wiener 


filter  behaves  more  like  inverse  filter.  This  leads  to  the  idea  of  adjusting 

the  effect  of  Sn/Sf  term  by  multiplying  it  by  a  factor  X  in  Eq.  (6)  which 
•  « 

gives  rise  to  the  so-called  parametric  Wiener  filter. 

The  presence  of  H  *(wx,  wy)  in  the  numerator  of  Wiener  filter  tends  to  make 
the  filtering  biased  towards  the  low  frequency  end.  To  combat  this  low- 
frequency  bias  the  so  called  geometrical  mean  filter  was  developed  and  will  be 
discussed  later. 

3.3  Parametric  Wiener  Filters  -  Although  Parametric  Wiener  filter  could  be 
derived  via  the  heuristic  approach  discussed  previously,  it  does  not  provide  a 
sense  of  optimality  nor  insight  for  obtaining  the  X  value  to  multiply  to  the 
^Sn/SfJ  term.  Mathematically,  using  the  model  In  Eq.  (2)  and  minimizing  the 
effective  noise-to-signal  ratio  of  the  restored  image  subject  to  the  constraint 


8 


that  the  residual  norm  between  the  observed  Image  and  the  reblurred  restored 

-  (8) 


Image  equal  to  the  norm  of  the  noise  results  In 

u .  _ 

where.  In  order  to  obtain  optimum  filtering  In  the  constrained  least-squares 


sense,  the  factor  Jf  must  be  chosen  such  that  the  constraint  Is  satisfied.  An 
algorithm  for  determining  this  X  value  exists. 13 

It  is  seen  from  Eq.  (8)  that  when  X  =  1,  Parametric  Wiener  filter  becomes 
Wiener  filter  and  when  =  0,  it  becomes  inverse  filter.  Choosing  arbitrarily  a 
value  (feo  )  will  cause  the  Wiener  filter  either  to  behave  more  like  Inverse 
filter  (?<!)  or  to  combat  noise  more  vigorously  (Jf>l  ).  The  X  value  cannot  be 
arbitrarily  assigned  to  obtain  optimum  filtering.  It  must  be  chosen  to  satisfy 
the  above  mentioned  constraint. 

3.4  Geometrical  Mean  filters  -  From  the  previous  discussion,  it  is  understood 
that  inverse  filtering  regains  the  original  image  completely  in  the  absence  of 
noise  provided  the  filter  is  non-singular.  However,  in  the  presence  of  severe 
noise  and/or  filter  singularities,  the  inverse  filtering  will  perform  badly;  it 
not  only  will  amplify  noise  but  also  accentuate  both  noise  and  image  signal  at 
the  singularities.  Wiener  filter,  on  the  other  hand,  will  restore  the  image 
(not  perfectly)  as  well  as  reduce  noise  and  it  can  never  be  singular  in  the 
presence  of  noise;  however,  it  does  tend  to  favor  the  low  frequency  portions  of 
the  image  and  thus  loses  sharp  edges.  One  thought  is  to  combine  inverse  filter 
and  parametric  Wiener  filters  in  such  a  way  as  to  parameterize  the  ratio  of 
their  effects  on  restoration.  By  judicious  choice  of  the  parameters,  it  is 
hoped  that  the  low  frequency  dominance  of  Wiener  filter  may  be  lessened  while 
some  singularities  of  the  inverse  filter  may  be  avoided.  Therefore,  Geometrical 
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mean  filters  are  defined  as: 


He*  (*»“>)  '  [h,(^)]  [H^ 


r  h* 

=  W*  !HI2*W5%,] 

L  J  (9) 

For  $- 1^  changes  from  a  complete  Wiener  filter  to  Inverse  filter  when  ««.. 
changes  continuously  from  0  to  1.  At  the  geometric  mean  (o(*  *s)  with  ¥•  1,  and 
for  symmetrical  PSF,  i.e.  H  (cOx)U^.)  is  a  real  function  and  f-|6lh (<*>*, to. )  in  Eq. 

(9)  becomes 


SsCvXJu>r) 


which  has  the  same  form  as  the  magnitude  of  PSE  filter. 

For  the  range  of^T<|and  any<*  oroCfcJj  and  any  Jf  ,  the  inverse  filtering 
effect  dominates.  On  the  other  hand,  for*<*s  and  fr>|  ,  the  Wiener  filtering 
effect  dominates  the  scene.  Hunt  14  showed  that,  for  moderate  blur  and  low  SNR, 
the  geometrical  mean  filter  with**  =  \  and  /  =  k  produced  good  result. 

3.5  PSE  (Power  Spectrum  Equalization)  filter  -  As  stated  earlier,  the  Inverse 
filter  restores  perfectly  in  the  absence  of  noise,  provided  there  Is  no 
singularity  in  the  blur  function;  however,  in  the  presence  of  noise,  it  attempts 
also  to  regain  the  Image  Information  in  the  noise  bands  and  thus  accentuates  the 
noise.  One  way  to  remedy  this  is  to  limit  the  gain  of  the  restoration  filter 


1 


for  the  low  SNR  bands  of  the  Image  spectrum.  Based  on  the  Image  model  in  Eq.  (2) 
and  with  the  constraint  that  the  PSD  of  the  restored  Image  is  equal  to  that  of 
the  original  Image,  the  PSE  filter  was  derived  as: 


and  the  phase  Is  set  equal  to  the  negative  of  the  phase  of  the  blur  spectrum.  15 
It  Is  seen  that  the  design  of  this  filter  does  not  require  knowledge  about  the 
noise  (spectrum). 

The  PSE  filter  can  also  be  obtained  by  settings  =  h  and  If  =  1  in  the  design 
of  geometrical  mean  filters.  Thus  PSE  filtering  has  the  combined  effect  of 
Inverse  filtering  and  Wiener  filtering  in  equal  strength. 

3.6  Median  filter  -  Median  filters  are  non-linear  filters.  This  family  of 
filters  is  not  derived  on  the  basis  of  an  image  model  and  a  set  of  mathematical 
criteria.  Median  filtering  was  first  suggested  by  Tukey  16  in  1971  for 
smoothing  time  series  and  noticed  its  property  in  preserving  large  sudden  changes 
of  level  (edges)  in  time  series.  It  has  later  been  adapted  for  use  in  image 
processing.  Median  filtering  is  performed  by  moving  a  window  over  the  pixels  of 
an  image  and  replacing  the  pixel  at  the  center  of  the  window  by  a  pixel  whose 
value  Is  the  median  of  the  original  pixel  values  within  the  window.  It  was  shown 
that  median  filtering  preserves  sharp  edges  and  is  very  efficient  in  smoothing 
"salt-and-pepper"  noise  but  not  very  effective  in  reducing  Gaussian  noise.  8 

The  mathematical  definition  of  median  filtering  is  given  as  follows: 

fai)-,’*.*™]  <12> 

where  w  is  the  filter  window;  denotes  a  pixel  of  the  image  usually  the 


•  • 


I 


■ 

■ 

» 

a 

i 


center  pixel  of  the  window  and  a  pixel  inside  the  window,  r  and  s  are 
varied  to  cover  all  the  pixels  in  the  window  and  varying  i  and  j  to  move  the 
window  to  cover  all  the  pixels  in  the  window  and  varying  i  and  j  to  move  the 
window  to  cover  another  portion  of  the  image.  The  filter  window  may  take  many 
forms  such  as  line  segments,  rectangles,  squares,  circles,  crosses,  square 
frames,  etc.  For  border  points,  the  median  is  usually  computed  on  those  points 
covered  by  the  window  (without  padding  zeros).  In  general,  the  number  of  pixels 
inside  the  window  is  odd;  otherwise,  the  mean  of  two  middle  points  is  taken  as 
the  median  value.  Because  of  the  difficulty  involved  in  the  theoretical 
analysis  of  median  filters,  there  has  been  practically  no  published  results. 
However,  efficient  median  filter  algorithms  have  been  developed.  17.  18 
Furthermore,  many  attempts  were  made  to  implement  median  filters  in  hardware 
which  will  perform  in  real  time.  19»  20 

A  median  filter  was  chosen  for  evaluation  because  of  its  simplicity  in 

design  and  potential  for  VLSI  implementation.  It  should  be  noted  that  this 
family  of  filters  was  designed  mainly  for  suppression  of  noise  while  preserving 
sharp  edges  with  no  attempt  or  regard  to  restore  a  blurred  image  to  its  original 
form.  It  must  be  used  with  caution. 
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SECTION  IV 


EXPERIMENT  CONDITIONS  &  CONSTRAINTS 

B 

4.1  Test  Data  Base  -  Because  of  the  time  limitation  for  this  project,  only  one 
picture  was  chosen  for  the  Image  restoration  filter  evaluation  experiment.  It 
|  Is  a  section  of  an  aerial  photo  of  a  test  site.  The  Image  selected  consists  of 

a  B-52  on  a  pedestal,  shadows  and  soil.  It  was  chosen  mainly  for  the  reason 
that  the  scene  can  be  easily  classlfed  by  machine.  This  Image  Is  shown  In  Its 
|  original  undistorted  form  and  blurred  forms  In  Fig  1.  The  Image  size  Is  256  x 

256  pixels.  In  order  to  create  a  diverse  group  of  distorted  images  to  allow 
different  filters  to  work  under  various  conditions,  the  Image  was  subjected  to 
different  degrees  of  degradation. 

Due  to,  again  limitations  in  time,  only  one  kind  of  blur  was  chosen;  viz; 
the  blur  with  a  Gaussian  PSF.  Three  levels  of  Gaussian  blurs  with  standard 
j  deviations  (T-  3  3.5,  4.5  and  6.5  were  used.  The  original  and  the  three  blurred 

Images  were  then  subjected  to  further  degradation  by  additive  zero-mean  white 
Gaussian  noise.  The  original  is  not  completely  noise  free.  It  has  a  small 
|  amount  of  noise.  Two  levels  of  additive  noise  corresponding  to  SNR  of  12dB  and 

5d8  were  used.  Thus,  the  data  base  for  testing  consists  of  12  images,  which 
Include  the  original,  three  images  degraded  by  blur  only  (shown  in  Fig  1)  two 
images  degraded  by  additional  noise  only,  (Fig  2)  and  the  others  degraded  by 
both  blur  and  noise  in  combinations  of  degrees  of  severity,  (Fig  3).  The 
degraded  images  were  restored  by  six  different  filters  which  are  described  in 
the  previous  section.  Thus  66  restored  images  were  produced  along  with  the  11 
test  images  and  original.  The  scene  of  each  of  the  images  was  classified  into 
three  categories,  viz.,  metal  (airplane),  shadow  and  soil.  The  number  of  pixels 
classified  into  each  class  was  then  counted  via  pattern  recognition  software. 
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The  result  of  classification  performed  on  the  original  image  was  taken  as  the 
reference  (truth)  based  on  the  assumption  that  the  machine  can  do  no  better  on 
the  degraded  images  than  on  the  original.  It  was  observed  that  noise  alone  had 
less  effect  on  machine  classification.  For  the  ease  to  compare  the  effect  due 
to  blur  the  77  images  (11  degraded  but  unrestored  and  66  restored)  were  divided 
into  three  groups  according  to  their  noise  levels.  Each  group  contains  28 
images  except  the  one  with  the  original  SNR  which  has  only  21  images.  They  were 
then  evaluated  and  compared  numerically  based  on  the  performance  measures  which 
will  be  described  in  4.5. 

4.2  Feature  selection,  classifier  and  machine  recognition  -  For  this 
investigation  two  features  (average  intensity  and  minimum  intensity  using  a  3  x 
3  window)  were  measured  and  the  condensed  nearest  neighbor  classifier  was  used 
as  the  machine  recognition  scheme.  The  features  and  the  classifier  were 
selected  by  cut-and-try  method.  No  attempt  was  made  to  find  the  best  features 
and  the  best  classifier  for  use  or  each  of  these  images;  similarly,  for  the  set 
of  training  regions  used.  Undoubtedly,  one  could  better  the  classification 
performance  on  each  image  by  choosing  the  best  features,  classifier,  and 
training  regions  for  that  particular  image,  however  that  would  defeat  our 
purpose  of  evaluating  and  comparing  filters  for  facilitating  machine 
recognition.  For  our  purpose,  the  effect  on  classification  due  to  factors  such 
as  training  regions,  features  selected,  classifier  used,  etc  must  be  minimized. 
Therefore,  in  the  strictest  sense,  our  results  pertain  only  to  the  specific  set 
of  experimental  circumstances.  However,  it  is  felt  that  the  results  obtained 
may  be  generalized  to  other  types  of  images,  classifiers,  etc.  as  far  as 
that  they  are  applicable.  Fig  4  shows  the  original  reference  image  along  with 
the  training  regions  selected.  Three  regions  were  trained  upon  for  soil  in 
order  to  obtain  a  composite  measure  for  that  category. 


•  • 


There  was  also  no  attempt  to  select  features  which  were  Improved  or  enhanced 
by  particular  restoration  filters.  In  other  words,  the  problem  of  feature 
selection  in  relation  to  the  use  of  restoration  filters  as  preprocessor  to 
machine  recognition  was  not  addressed  here.  The  understanding  of  the 
Interrelation  between  the  preprocessor  (filters  and  enhancements)  and  the 
feature  extractor  is  important  for  any  practical  application  of  machine 
recognition. 

4.3  Specific  Filter  Constraints:  For  the  Parametric  Wiener  filters  used 
herein,  K  was  arbitrarily  set  equal  to  No  attempt  was  made  to  determine  the 
best  y  value.  Similarity  for  the  geometric  mean  filter,  and  y  were  chosen 
arbitrarily  to  be  H  and  h  respectively.  Therefore  the  results  reported  here  are 
for  those  special  cases  of  the  Parametric  Weiner  and  Geometric  Mean  filters 
chosen  and  caution  should  be  taken  in  generalization  of  the  results.  For  the 
median  filter  only  a  3  x  3  window  was  used.  It  is  generally  known  that  window 
size  and  shape  affects  filter  response  however,  because  of  expediency  this 
experiment  considered  only  the  3x3  window. 

4.4  Software  Discussion  -  Two  software  packages  were  employed  to  carry  out  the 
experiment.  They  are  the  IRAMS  and  the  AFES  (Automatic  Feature  Extraction 
System)  both  of  which  were  developed  and  installed  by  PAR  Technology  Corp  for 
RADC  to  support  R&D  and  DMA  production  requirements.  Application  software 
provided  with  the  AFES  supports  pixel  measurement  extraction,  pixel 
classification,  image  preprocessing,  enhancement,  filtering,  etc.  A  complete 
description  of  the  AFES  hardware  and  software  may  be  found  in  Technical  Report 
RADC  TR  82-200.  This  software  package  was  used  to  perform  the  classification 
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(para  4.2)  on  the  test  imagery.  Figures  5,  6,  7  and  8  are  representative  of  the 
results  obtained  by  using  the  software  to  automatically  classify  test  images 
into  the  three  categories  selected  (metal,  soil  and  shadow).  Fig  5  shows  the 
results  obtained  on  the  reference  image  i.e.  original  and  is  used  to  evaluate 
performance  of  restoration  for  machine  classification  via  the  measure  derived  in 
para  4.5.  Fig  6  shows  the  classification  results  on  a  specifically  degraded 
image,  and  Figs  7  and  8  give  results  after  that  image  is  restored  via  two 
filters  with  extreme  performances.  Note  the  confusion  in  the  lower  left  corner 
of  the  image  where  a  number  of  soil  pixels  were  misclassif ied  as  shadow.  Fig  7 
(Wiener  Filter  shows  improvement  while  Fig  8  (Median)  is  worse  than  the 
unrestored/classified  image.  These  results  are  discussed  in  more  detail  in 
Section  V. 

The  IRAMS  software  package  is  integrated  into  the  AFES  control  and  application 
software.  Since  IRAMS  is  structured  within  AFES,  it  offers  a  unique  tool  for 
developing  and  evaluating  preprocessing  techniques  in  an  automatic  pattern 
recognition  feature  extraction  environment.  The  IRAMS  package  contains  modules 
to  perform  image  degradation  assessments  on  real  world  images,  and  to  design  and 
apply  a  number  of  restoration  filters  to  the  degraded  images.  The  restoration 
filters  implemented  in  IRAMS  may  be  grouped  as  linear  and  nonlinear.  The 

investigation  in  this  report  addressed  each  of  the  linear  filters.  The  only 
non-linear  case  considered  was  the  median  filter  implemented  as  a  3  x  3  window. 
4.5  Performance  Measure  Derivation  -  In  the  experiment,  after  performing 
classification  on  the  images,  pixels  classified  into  each  class  were  counted. 


Comparing  directly  these  pixel  counts  of  images  restored  by  various  filters  is 
not  only  cumbersome  but  also  leads  to  difficulty  in  ranking  the  filters.  The 
conventional  percentage  of  correct  classification  or  confusion  matrix  cannot  be 
used  here  since  it  is  not  feasible  to  identify  each  individual  pixel  as  being 
wrongly  or  correctly  classified;  only  the  number  of  pixels  classified  into  each 
class  can  be  counted  with  little  difficulty. 

The  deviation  of  the  pixel  counts  per  class  obtained  on  the  restored  images 
from  those  counted  on  the  original  image  gives  a  measure  of  the  size  of  the  area 
being  wrongly  classified.  It  was  thought  that  this  deviation  for  the  particular 
class  would  serve  as  a  figure  of  merit  to  measure  the  filter's  capability  in 
facilitating  the  classification  of  pixels.  However,  with  a  little  more 
reflection,  the  severity  of  each  deviation  should  be  considered  since  it  is  more 
severe  to  wrongly  classify  2  pixels  out  of  10  pixels  than  to  misclassify  2 
pixels  out  of  100.  Therefore,  the  misclassif ication  index  for  the  ith  class  was 
formulated  as: 


~  hJc* 
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(12) 

where  Nci  =  no.  of  pixels  truly  belonging  to  the  ith  class. 

Nai  =  no.  of  pixels  actually  classified  into  the  ith  class  by 

machine.  In  our  case,  Nci  is  determined  by  performing  machine  classification 
on  the  original  undegraded  image  as  discussed  before.  It  is  noted  that^  has  a 
range  of 
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where  =  total  no.  of  classified  pixels  in  the  image.  The  extreme  points  in 

the  range  Indicate  that  either  no  pixel  is  classified  into  the  1th  class  or  all 
pixels  are  classified  into  it.  It  is  seen  then  that  a  negative  value 
signifies  that  the  ith  class  is  underclassified  and  a  positive  value, 
overclassified.  When£^=.o.  it  Indicates  the  best  performance  for  classifying 
pixels  into  the  ith  class.  However,  it  does  not  provide  a  single-number  as  an 
overall  performance  measure. 

Often,  it  is  desirable  to  have  a  single-number  index  to  gauge  the  overall 
performance  in  classifying  pixels  into  all  classes  under  consideration.  Summing 
over  C-L  would  not  do  since  that  allows  underclassification  and 
overclassification  to  cancel  each  other  but  both  kinds  of  misclassif ication  are 
equally  harmful.  A  meaningful  overall  performance  measure  is  thus  defined  as 
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where  n  designates  the  number  of  classes. 

This  measure  has  a  theoretical  range  of 

o  ~ 

where £*max  is  derived  under  the  worst  situation  when  every  pixel  is  classified 
into  the  class  of  the  smallest  size.  Let  Nes  be  the  number  of  pixels  in  the 
smallest  class,  then 

(14) 

However,  in  practice,  it  is  more  likely  that  every  pixel  is  swamped  into  the 
class  of  the  largest  size.  In  that  case,  the  largest  value  of  £  that  will  ever 
result  will  be  less  than  the  max  in  Eq.  (14).  A  practical  range  of  values  is 
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where  NCjLis  the  number  of  pixels  in  the  largest  class.  Therefore,  in  o 
apprehend  the  significance  of  the  values  for  £  ,  one  should  always  anal, 
range  of  £  values  that  may  arise  in  any  particular  application.  This  re 
maximum  value  may  be  used  to  normalize  so  that  the  index  varies  between  0 
The  best  performance  occurs  when  <£  =  0.  This  misclassification  index 
good  indication  of  the  performance  of  a  filter  pertinent  to  the 
classification  for  all  classes  under  consideration. 

Both  types  of  the  misclassification  indices  were  used  herein.  The  cl 
class  index  was  employed  to  evaluate  and  compare  the  image  restoration 
for  their  capability  in  aiding  the  classification  of  pixels  into  a  par 
class;  the  overall  measure  was  used  to  evaluate  and  compare  the  filti 
their  overall  performance  in  classification  for  all  the  classes 
consideration. 


SECTION  V 


RESULTS  &  DISCUSSION 


The  numerical  evaluation  and  comparison  of  filter  performance  is  based  on 
the  misclassification  indices  (classification  errors)  described  in  the  previous 
section.  These  results  are  presented  In  Tables  I,  II,  III  and  IV.  The  values 
of  Table  I  represent  the  classification  errors  for  the  metal  (airplane);  those 
of  Table  II,  the  errors  for  the  soil;  those  of  Table  III,  the  errors  for  the 
shadow;  and  the  values  of  Table  IV,  the  classification  errors  for  all  three 
classes.  Negative  values  represent  underclassification  while  positive  values 
show  overclassification  as  compared  to  the  original  image  pixel  counts.  The 
consistency  and  patterns  exhibited  by  these  values  show  the  utility  of  the 
performance  measures  derived.  The  range  for  the  values  of  each  table  is  listed 
below: 


Table  Range 


I 

-1 

6.0115 

II 

-1 

0.3304 

III 

-1 

8.4608 

IV 

0 

10.4608 

The  range  for  the  overall  misclassification  index  (Table  IV)  was  computed  based 
on  the  assumption  that  every  pixel  would  be  classified  as  shadow  when  the  image 
is  hopelessly  degraded.  In  all  cases,  a  zero  value  indicates  the  best 
performance.  Hence,  the  closer  to  zero  the  index  value,  the  better  the 
performance. 


The  metal  Is  much  brighter  than  soil  or  shadow  and  hence  easier  to  classify. 
However,  shadow  and  soil  characteristics  are  quite  similar  to  begin  with  and 
become  even  more  alike  after  degradation  of  the  Image  and  hence  difficult  to 
separate.  It  Is  seen  from  Table  I  that  practically  all  of  the  filters 

facilitated  the  classification  of  pixels  Into  metal  under  any  distortion 

condition.  From  Tables  II  and  III,  It  Is  seen  that  the  performances  of  filters 

are  not  clear  cut;  some  of  them  facilitated  the  classification  for  soil  at  the 
expense  of  shadow  and  vice  versa.  For  example,  Wiener  filter  Improved  the 
classification  of  pixels  into  soil  and  shadow  at  all  noise  levels  and  blur 
severities  of  <T-  =  4.5  and  6.5;  however,  at  SNR  =  12  db  and  0“  =  6.5,  it 

did  not  Improve  the  soil  classification  but  helped  greatly  for  the  shadow 
classification;  on  the  other  hand,  at  SNR  =  5  dB  and  CJ—  =  4.5  it  performed 
well  for  the  soil  but  badly  for  the  shadow.  For  the  overall  performance;  i.e., 
facilitating  the  classification  for  all  three  classes,  it  is  seen  from  Table  IV 
that  at  high  noise  level  and  severe  blur,  all  filters  except  the  Inverse  and 
Parametric  Wiener  filters  improved  overall  classification.  The  behavior  of 
Inverse  filter  at  high  noise  level  and  severe  blur  is  expected.  The  erratic 
performances  of  parametric  Wiener  (PW)  and  Geometrical  Mean  (GM)  filters  proved 
again  the  Importance  of  selecting  the  value  (for  the  PW  filter)  and  j  Z 
values  (for  the  GM  filter).  The  value  for  if  used  for  PW  filter  here  does 

not  seem  to  work  well  for  high  level  of  noise  and  severe  blur  condition.  The 


PSE  filter  has  the  worst  record  (3.5845)  among  all  the  filters;  this  occurred  at 
the  original  SNR  and  blur  ofd"*  6.5.  It  did  improve  metal  classification  but 
mlsclasslfled  many  soil  pixels  Into  the  shadow  class.  As  mentioned  earlier,  the 
PSE  filter  limits  the  gain  for  the  low  SNR  bands  of  the  image  spectrum.  After 
severe  blur,  at  the  original'  SNR,  the  SNR  of  the  soil  band  became  relatively 
lower.  Hence,  many  soil  pixels  became  darker  and  thus  were  classified  as 
shadow. 

The  median  filter  (3x3  window)  improved  the  classification  of  metal  for 
images  of  high  noise  and  severe  blur;  for  classification  of  shadows  and  soil, 
its  performance  was  mixed.  This  is  In  line  with  its  character  in  preserving 
contrast  while  reducing  noise.  It  also  showed  good  overall  performance  In 
facilitating  classification  of  pixels  Into  all  three  classes. 

Examining  Table  IV,  filters  did  not  help  under  noise  alone  situation  even 
though  the  filters  had  filtered  out  noise.  This  shows  that  noise  alone  has 
little  effect  on  classification.  The  filters  Improved  classification  In  the 
situations  when  high  noise  and  severe  blur  were  combined.  These  results  agree 
somewhat  with  the  results  reported  In  Ref.  11  for  human  observers  as  stated  In 
Sec.  I  of  this  report.  Of  course,  the  results  obtained  could  be  due  to  the 
characteristics  of  our  particular  features  (measurements)  used  In  the  pattern 
recognition  system.  Any  generalization  of  our  results  must  be  made  with 
caution. 

For  ease  of  comparison,  graphs  may  be  constructed  from  the  tables.  A 
typical  graph  Is  shown  In  Fig.  2.  The  graph  represents  the  group  of  Images  at 


12  db  SNR  In  Table  IV  which  portrays  the  overall  classification  performance. 
The  abscissa  of  the  graph  shows  the  blur  severity  Measured  In  the  standard 
deviation  of  the  Gaussian  blur  and  the  ordinate  represents  the  relative  overall 
classification  error  within  the  group.  The  graph  shows  that  the  Wiener  filter 
performed  well  for  all  blur  severities  at  12  d8  SNR;  the  Geometrical  Mean  Filter 
(•*  =  JT  *  %)  Is  best  for  the  blur  of  tf-  *  4.5  at  12  dB  SNR;  the  PSE  and 
Wiener  filters  performed  at  about  the  same  level  under  the  most  severe  blur;  the 
Inverse  filter  did  not  work  well  for  the  most  severe  blur  at  this  noise  level  as 
expected;  the  Parametric  Wiener  filter  did  not  perform  well  because  the  value 
used  here  was  not  optimized  for  this  combination  of  blur  and  noise;  the  Median 
filter  did  not  help  at  all  since  there  were  no  sharp  boundaries  between  shadows 
and  soil.  The  plot  shows  that  at  a  12  db  SNR  level  filtering  does  not  Improve 
classification  for  less  severe  blur.  It  is  also  observed  that  the  line 
connecting  all  the  UR  (unrestored)  points  In  the  graph  and  the  line  through  the 
middle  of  the  filters  Intersects  at  <r*  3.5.  Extending,  this  observation.  It 
seems  that  at  this  noise  level  for  a  blur  less  severe  than  a  Gaussian  blur  off^ 
3.5,  one  should  not  use  image  restoration  filter  to  facilitate  machine 
classification.  Other  graphs  c?.n  be  constructed  for  groups  of  other  noise 
levels.  They  show  similar  patterns  of  behavior  except  that  most  of  the  filters 
Improved  classification  for  less  severe  blur  at  high  noise  level. 


SECTION  VI 


SUMMARY  ANO  CONCLUSIONS 


I 

I 

i 
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The  major  objective  of  this  work  was  to  evaluate  and  compare  a  number  of 
digital  restoration  filters  for  facilitating  machine  classification  in  support 
of  future  automatic  feature  extraction  applications.  This  objective  has  not 
been  reported  on  In  the  past  and  represents  a  novel  performance  measure  for 
Image  restoration  filtering. 

Because  of  time  and  funding  limitations  the  study  was  rather  limited.  A 
single  test  Image  was  selected  and  subjected  to  various  degrees  of  blur  and 
noise  to  form  a  test  data  base  consisting  of  12  Images  with  varying  degrees  and 
combinations  of  degradation.  These  Images  were  restored  via  six  Image 
restoration  filters  and  subjected  to  a  previously  developed  Image  classifier  for 
machine  classification.  No  attempt  was  made  to  select  optimum  features  and 
measures  used  by  the  classifier,  therefore  the  results  reported  herein  are 
constrained  to  a  very  specific  pattern  recognition  system  based  on  two  feature 
measurements  and  a  limited  test  data  set.  Extreme  caution  must  be  exercised  In 
generalizing  the  results  and  observations  beyond  the  specifics  of  the 
experimentation  performed.  Nevertheless,  the  results  show  that  Image 
restoration  filtering  enhances  machine  classifications  In  cases  of  high  noise 
and  moderate  to  severe  blur  or  a  combination  of  low  noise  and  severe  blur. 

Although  no  attempt  was  made  In  the  study  to  compare  machine 
classification  performance  with  human  Interpretablllty  of  restored  Images,  a 
number  of  observations  were  made  which  are  consistent  with  results  for  human 
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Interpretablllty  reported  by  others.  10,  11  Notably,  blur  Is  a  more  serious 
form  of  degradation  than  noise  alone  for  both  human  and  machine  Interpretation. 

In  order  to  evaluate  performance  of  restoration  filtering  for  machine 
classification,  a  non-subjectlve  performance  measure  was  required.  Consequently 
a  performance  measure  based  upon  a  mlsclasslflcatlon  of  pixel  Index  was  derived. 
This  Index  was  refined  to  obtain  a  single  quantitative  number  to  measure  how 
well  a  restoration  filter  performed.  This  measure  was  used  throughout  the 
experimentation  and  proved  to  be  a  useful  means  for  evaluating  individual 
filter  performance  and  comparing  performance  between  filters.  Fig  10  Is 
Included  to  show  the  results  of  restoring  a  specific  Image  by  three  different 
filters.  If  those  results  were  submitted  for  human  Interpretation,  one  can 
begin  to  understand  the  difficulty  In  defining  "best"  performance.  However,  the 
measure  derived  in  this  report  provides  a  useful  quantitative  performance 
measure  for  machine  classification. 

In  conclusion  a  number  of  points  should  be  emphasized.  The  experimentation 
performed  in  this  study  provides  results  which  are  useful  for  consideration  In 
machine  classification  applications.  Because  of  time  and  funding  constraints,  a 
limited  set  of  experimental  conditions  were  addressed  and  care  should  be 
exercised  In  generalizing  the  results  obtained.  During  the  performance  of  the 
work  reported  herein,  a  number  of  questions  arose  which  should  be  considered  for 
future  research.  These  questions  are  paraphrased  below  in  the  form  of 
recommendations  for  future  research. 

a.  What  features  of  a  digital  image  are  enhanced  through  application  of 
restoration  filters  for  machine  recognition  applications? 

b.  Determine  the  set  of  features  which  are  enhanced  by  specific  filters  or 
sets  of  filters. 
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c.  How  do  Image  restoration  filters  or  enhancement  techniques  Interrelate 
with  feature  extractors  and  classifiers? 

The  answers  to  the  above  questions  will  provide  the  technical  knowledge  required 
to  understand  the  Interrelation  between  preprocessing  (such  as  restoration 
filtering),  feature  extractors  and  machine  classifiers  in  order  to  Improve  upon 
the  performance  of  an  automated  feature  extraction  system  as  a  whole  rather  than 
in  piecemeal.  These  Issues  are  essential  before  Image  restoration  and 
enhancement  can  be  optimized  for  machine  classification  In  automated  feature 
extraction  applications. 


TABLE  I  -  RELATIVE  CLASSIFICATION  ERRORS  FOR  METAL  (AIRPLANE) 


SNR 

UR 

I 

W 

PW 

GM 

PSE 

M 

Original 

2.5 

-.0462 

-.0414 

-.0678 

-.0724 

-.0625 

-.0371 

-.0722 

4.5 

-.1500 

-.1373 

-.0623 

-.1349 

-.0884 

-.1399 

-.1514 

6.5 

-.3528 

-.1442 

.0593 

.1499 

-.0645 

-.0434 

-.1544 

12dB 

0 

.0051 

.0063 

-.0024 

-.0007 

.0001 

.0077 

.0255 

2.5 

-.0536 

-.0619 

-.0422 

-.0416 

-.0388 

-.0413 

-.0287 

4.5 

-.1470 

-.0926 

-.1148 

-.1446 

-.1299 

-.1438 

-.0750 

6.5 

-.2032 

.0221 

-.2209 

-.2237 

.0623 

-.1970 

.1560 

5  dB 

0 

.0136 

.0077 

.0221 

.0111 

.0020 

.0392 

.0506 

2.5 

-.0298 

-.0065 

-.0092 

-.0169 

-.0102 

-.0021 

.0225 

4.5 

-.1314 

-.0635 

-.0996 

-.0758 

-.1936 

-.0810 

-.0290 

6.5 

-.1920 

-.2238 

-.1467 

.0315 

-.0980 

-.2447 

-.1256 

Range:  -1.000 

6.0115 

n:  standard  deviation  of  Gaussian  blur 
UR:  Unrestored 
I:  Inverse  filtering 

W:  Wiener  filtering 

PW:  Parametric  Wiener  filtering  (/«•») 

GM:  Geometrical  Mean  filtering  4,  /  ■  *») 
PSE:  Power  spectrum  equalization  filtering 
M:  Median  filtering 

Neg.  No.:  Underclasslfled 
Pos.  No.:  Overclasslfled 


TABLE  II  RELATIVE  CLASSIFICATION  ERRORS  FOR  SOIL 


SNR 

UR 

I 

H 

PW 

m 

PSE 

N 

Original 

2.5 

.0125 

.0029 

.0150 

.0115 

.0168 

.0112 

.0141 

4.5 

.0348 

.0322 

.0162 

.0383 

-.0121 

.0303 

.0373 

6.5 

-.0345 

.0172 

.0026 

-.1601 

-.1*12 

-.4293 

.0357 

12d8 

0 

-.0020 

.0182 

.0036 

.0053 

.0105 

.0025 

.0089 

2.5 

.0141 

.0212 

.0175 

.0207 

.0209 

.0250 

.0131 

4.5 

.0497 

.0330 

.0367 

.0389 

.0245 

.0382 

.0380 

6.5 

-.0233 

-.1106 

.0642 

-.1082 

-.0611 

.0064 

-£215 

5  dB 

0 

-.0047 

-.0039 

.0157 

.0095 

.0081 

-.0035 

-.0042 

2.5 

.0185 

.0114 

-.0116 

-.0086 

.0029 

.0129 

.0127 

4.5 

.0300 

.0216 

.0125 

-.0093 

.0476 

.0043 

.0184 

6.5 

-.0683 

-.0668 

-.0207 

-.1479 

-.0262 

-.0475 

-.0106 

Range:  -1.000  -  0.3304 
Symbols  explained  In  Table  I. 


TABLE  III  RELATIVE  CLASSIFICATION  ERRORS  FOR  SHADOWS 


SNR 

UR 

I 

W 

PW 

SM 

PSE 

M 

Original 

2.5 

-.0263 

.0355 

-.0150 

.0157 

-.0350 

-.0296 

-.0027 

4.5 

-.0534 

-.0440 

-.0315 

-.1009 

.2055 

-.0264 

-.0608 

6.5 

-.1959 

.0709 

-.0985 

.9365 

1.0204 

3.1118 

-.0456 

20dB 

0 

.0074 

.1390 

-.0226 

-.0367 

-.0751 

-.0285 

.0291 

2.5 

-.0283 

-.0675 

-.0674 

-.0915 

-.0962 

-.1218 

-.0541 

4.5 

-.1834 

-.1098 

-.1061 

-.0817 

.0088 

-.0773 

.3714 

6.5 

.4398 

1.4954 

-.1583 

1.0712 

-.3507 

.2203 

1.3645 

5  dB 

0 

.0153 

.0175 

-.1411 

-.0825 

-.0606 

-.0281 

-.0381 

2.5 

-.0910 

-.0724 

.0947 

.8239 

-.0066 

-.0889 

-.1206 

4.5 

.3925 

-.0680 

.2244 

.1683 

-.0771 

.0790 

-.0915 

6.5 

.7447 

.7772 

.3450 

1.0091 

.3185 

.6680 

.2447 

Range: 

-1.000 

-*8.4608 

Symbols  explained  In  Table  I. 
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TABLE  IV  RELATIVE  CLASSIFICATION  ERRORS  tor  ALL  THREE  CLASSES 


SNR 

UR 

I 

W 

PH 

GM 

PSE 

N 

Original 

2.5 

.0850 

.0798 

.0977 

.0996 

.1144 

.0779 

.0889 

4.5 

.2382 

.2135 

.1100 

.2741 

.3060 

.1966 

.2495 

6.5 

.5832 

.2323 

.1604 

1.2466 

1.2162 

3.5845 

.2358 

12  d8 

0 

.0145 

.1641 

.0286 

.0427 

.0857 

.0387 

.0635 

2.5 

.0960 

.1507 

.1270 

.1538 

.1559 

.1881 

.0958 

4.5 

.3801 

.2355 

.2577 

.2652 

.1553 

.2593 

.4844 

6.5 

.6663 

.8891 

.4435 

1.4031 

.4741 

.4237 

1.7420 

5  dB 

0 

.0337 

.0292 

.1789 

.1031 

.0708 

.0708 

.0929 

2.5 

.1393 

.0903 

.1155 

.1093 

.0197 

.1040 

.1558 

4.5 

.5539 

.1532 

.3366 

.2533 

.3183 

.1643 

.1388 

6.5 

1.0049 

1.0678 

.5123 

1.1885 

.4427 

.9602 

Range:  0  -  ♦ 10.4608 
Symbols  explained  In  Table  I 
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Figure  1  Original  Image  and  Blurred  Forms 
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Figure  4  Original  Image  Depicting  Supervised  Training  Regions 
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• 

• 

Figure  5  Original 

Images/Classification  via  AFES  Software 

• 

35 

• 

• 

Figure  6  Classification  Results  on  Degraded/Unrestored  Image 


Figure  10  A  Test  Image  Restored  via  Wiener, 
Median  and  Geometric  Mean  Filtering 
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